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<n: Abstract. General models of network navigation must contain a deter- 

ministic or drift component, encouraging the agent to follow routes of 
least cost, as well as a random of diffusive component, enabling free wan- 
dering. This paper proposes a thermodynamic formalism involving two 
path functionals, namely an energy functional governing the drift and an 
entropy functional governing the diffusion. A freely adjustable param- 
eter, the temperature, arbitrates between the conflicting objectives of 
minimising travel costs and maximising spatial exploration. The theory 
ryj , is illustrated on various graphs and various temperatures. The resulting 

O ■ optimal paths, together with presumably new associated edges and nodes 

centrality indices, are analytically and numerically investigated. 

> 

^ | 1 Introduction 

in" 

' Consider a network together with an agent wishing to move (or wishing to move 

goods, money, information, etc.) from source node s to target node t. The agent 
t**"*- 1 seeks to minimise the total cost or duration of the move, but the ideal path 

may be difficult to realise exactly, in absence of perfect information about the 
network. 

The above context is common to many behavorial and decision contexts, 
among which "small- word" social communications (Travers and Milgram 1969), 
k> . spatial navigation (e.g. Farnsworth and Beecham 1999), routing strategy on in- 

5_i 1 ternet networks (e.g. Zhou 2008), and several others (e.g. Borgatti 2005; Newman 

2005). 

Trajectories can be coded, generally non-univocally, by X = (xy) where 
Xij — "number of direct transitions from node i to node j" . The use of the flow 
matrix X is central in Operational Research (e.g. Ahujaet al. 1993) and Markov 
Chains theory (e.g. Kemeny and Snell 1976); four optimal si-paths have in 
particular been extensively analysed separately in the litterature, namely the 
shortest-path, the random walk, the maximum flow (Freeman et al. 1991) and 
the electrical current (Kirchhoff 1850). 

This paper investigates the properties of si-paths resulting from the min- 
imisation of a free energy functional F(X), over the set X 6 X of admissible 
solutions. F{X) contains a resistance component privileging shortest paths, and 
an entropy component favouring random walks. The conflict is arbitrered by a 
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continuous parameter T > 0, the temperature (or its inverse {3 := 1/T), and 
results in an analytically solvable unique optimum continuously interpolating 
between shortest-paths and random walks. 

Section[2]introduces the formalism, in particular the energy functional (based 
upon an edge resistance matrix R, symmetrical or not) and the entropy func- 
tional (based upon a Markov transition matrix W, reversible or not). Section 
12.51 provides the analytic form of the unique solution minimising the free energy. 
Section @] proposes the definition of edge and vertex betweenness centrality in- 
dices directly based upon the flow X. They are illustrated in sections [3] and [3] 
for various network geometries at various temperatures. 



2 Definitions and solutions 
2.1 Admissible paths 

Consider a connected graph G — (V,E) involving n — \V\ nodes together with 
two distinguished and distinct nodes, the source s and target t. The si-path 
or flow matrix, noted X st — (xfj) or simply X — (xij), counts the number of 
transitions from i to j along conserved unit paths starting at s and absorbed at 
t. Hence 

> positivity (1) 

x%m — x m i — Si S — Su unit flow conservation (2) 

where Sij is the Kronecker delta, the components of the identity matrix. Here 
and in the sequel, • denotes the summation over the values of the replaced index, 
as in Xi, — X>j=i x ij- I n particular, x sm — x ms + 1. Also, absorbtion at t yields 

Xf — absorbtion at t (3) 

entailing x t j = for all j, and x, t = 1. Condition can be generalised to 
valued flows 

Xim — x % i — v(Si S — Sit) conservation for valued flow (4) 

where v > 0, the amount sent through the network, is the value of the flow. 
Further familiar constraints consist of 

capacity, where cy > (5) 

minimum flow requirement, b^j > (6) 

forbidden node jo (7) 

forbidden arc («ojo) • (8) 



Xij ]S Cij 

Xij ^ b'ij 

x *jo = 

x iojo = 
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2.2 Mixtures and convexity 

Any of the above constraints ([T]) to ((5J or combinations thereof defines a convex 
set X of admissible si-paths: if X and Y are admissible, so is their mixture 
aX + (1 — a)Y for a G [0, 1]. Mixture of paths are generally non-integer, and 
can be given a probabilistic interpretation, as in 

• x, m — "average time (number of transitions) for transportation from s to i" 

• Xij/xi m = "conditional probability to jump to j from i" . 

Unless otherwise stated, we will consider from now on unit flows X, generally 
non- integer, obeying fT}, @ and 

2.3 Path entropy and energy 

Let W = (wij ) denote the (n x n) transition matrix of some irreducible Markov 
chain. A si-path constitutes a random walk (as defined by W) iff Xij/xi, = my 
for all visited node i, i.e. such that Xi, > 0. Random walk si-paths X minimise 
the entropy functional 

G(X) :=J2 x ij ln = E Xi.Ki(X\\W) = x.. £ ^- Kl {X\\W) 

■ ■ Xit Wij Xa 

ij J % i 

where ^(XljW 7 ) := ^ ■ ln X X%3 W . > is the Kullback-Leibler divergence 
between the transition distributions X and W from i, taking on its minimum 
value zero iff ^ii = Wij. Note G(X) to be homogeneous, that is G(vX) = vG(X) 
for v > 0, reflecting the extensivity of G(X) in the thermodynamic sense. 

By contrast, shortest-paths and other alternative optimal paths minimize 
resistance or energy functionals of the general form 

U{X) :=^r l3 ip(x l3 ) 

where r i} > represent a cost or resistance associated to the directed arc ij, 
and tp(x) is a smooth non-decreasing function with </?(0) = 0. In particular, 
minimizing U(X) yields 

• si-shortest paths for the choice f(x) — x, where r« is the length of the arc 

ij 

• si-electric currents from s to i for the choice fix) — x 2 /2, where Tij is the 
resistance of the conductor ij (see section [2^8]) . 

As in Statistical Mechanics, we consider in this paper the class of admissible 
paths minimizing the free energy 



F(X) := U(X) + TG(X) 



(9) 
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Here T > is a free parameter, the temperature, controlling for the importance of 
the fluctuation around the trajectory of least resistance or energy (ground sate), 
realised in the limit of low temperatures T — > 0. In the limit of high temperatures 
T — y co (or f3 — > 0, where /3 := 1/T is the inverse temperature), the path consists 
of a random walk from s to t governed by W . Hence, minimising the free energy 
(|9j) generates for T > "heated extensions" of classical minimum-cost problems 
minx U(X), with the production of random fluctuations around the classical, 
"ground state" solution. 

Derivating the free energy with respect to Xij, and expressing the conser- 
vation constraints ([2]) through Lagrange multipliers {A^} yields the optimality 
condition 

T In + njip'ixij ) = Xj- \i (10) 

Xi*Wij 

that is 

x^ = Xi.Wij exp(-p[rijip'(xij) + Xj - A,;]) . (11) 

The multipliers are defined up to an additive constant. They can be fixed if 
needed by arbitrarily setting A s = 0. In any case, iy = when Wij = or i = t. 

2.4 Minimum free energy and uniqueness 

Multiplying (I10[) by x^j and summing over all arcs yields an identity involving 
the entropy G(X) of the optimal path X. Substitution in the free energy together 
with ([2]) demonstrates in turn the identity 

minF(X) = ^ry^fiy) - (p'(xij)xij] + A t - X s (12) 

ij 

The first term is negative for <p(x) convex, positive for (p(x) concave, and zero 
for the heated shortest-path problem ip(x) = x, for which minx F(X) = X t — X s . 

Also, the entropy functional is convex, that is G(aX + (1 — a)Y) < aG(X) + 
(1 — a)G(Y) for two admissible paths X and Y and < a < 1. The energy 
U{X) is convex (resp. concave) iff ip(x) is convex (resp. concave). 

When a strictly convex functional F(X) possesses a local minimum on a 
convex domain X, the minimum is unique. In particular, we expect the optimal 
flows for tp(x) — x p to be unique for p > 1, but not anymore for < p < 1, 
where local minima may exist. In the shortest-path problem p — 1, the solution 
is unique if T > (Section [53]); when T = 0, local minima of U(X) may coexist, 
yet all yielding the same value of U(X). 

2.5 Algebraic solution 

Solving (fTTj) is best done by considering separately the target node t. Define 
Vij :— Wij exp(— f3ri 3 ip'(xij )) as well as the (n — 1) x (n — 1) matrix V = (vij)i_j^ t - 
Also, define the (n — 1) dimensional vectors 



a := (exp^A,))^ b := (x it exp(-0Xi))i^ t (13) 

q ■= {v it )i^t e := (5 is )i^ t 
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Summing over i, respectively j, and using ((2|) and ([3|) yields 
V^a + qexp(^A t ) = a = 6 - exp(-/3A s )e fc'g = exp(-^Aj) 

Define the (n — 1) x (n — 1) matrix M = (my) and the (n — 1) vector z as 

M := (I -Vy 1 = I + V + V 2 ... z:=Mq (14) 

Then a and b express as 

a ?; = exp(/3A s ) — 6, = exp(-/3A s ) m si 

implying incidentally (compare with a in (|13p) 

/3 (Aj — Aj) = lnzj — Inzj . (15) 

Finally 



Z s 



m S i Vij — (i^t) 
(Mz) s (M 2 q) s 



(Mq) 6 



(16) 
(17) 



In general, V, M, q and d depend upon X. Hence ([TI)1) and (JTTJ) define a recursive 
system, whose fixed points may be multiple if U(X) is not convex (Section l2.4[) . 
but converging to a unique solution for p > 1. In the heated shortest-path case 
p = 1, the above quantities are independent of X. Hence the solution is unique, 
and computable in one single step, as illustrated in Sections [3] and [5] 



2.6 Probabilistic interpretation 

In addition to the absorbing target node t, let us introduce another "cemetery" 
or absorbing state 0, and define an extended Markov chain P on n + 1 states 
with transition matrix 



P = 





i ^ t,0 


t 


°\ 


i^t.O 


V 


q 


p 


t 





l 














i/ 



where pi = 1 — X)fc=i i s the probability of being directly absorbed at from 
i. 

From (fl4l . M — (m^) is the so-called fundamental matrix (see e.g. Kemeny 
Snell 1976 p. 46), whose components my give the expected number of visits 
to j from i, before being eventually absorbed at or t. Also, z% (with i ^ 
t, 0) is the "survival probability" , that is to be, directly or indirectly, eventually 
absorbed at t rather than killed at 0, when starting from i. The higher the node 
survival probability, the higher the value of its Lagrange multiplier in view of 
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(I15p . Consistency entails the condition z t = 1, making At > A; for all i. In 
particular, in view of (fT2|) . the free energy of the heated shortest-path case is 



increasing with the risk of being absorbed at from s. 

2.7 High-temperature limit 

The energy term disappears in the limit T — > oo (that is (5 — > 0), and so does 
the absorbing state above in view of pi — 0. In particular, Zi = 1, Xi = 0, and 
= rrisiWij for i ^ t. 

Also, a;®* is the expected number of transitions needed to reach t from s. 
The commute time distance x s , % + x*^ is known to represent a squared Euclidean 
distance between states s and t (see e.g. Fouss et al. 2007, and references therein). 

2.8 Low-temperature limit 

Equations (ITT1) . (fT6t and (fTT)) show the positivity condition x^ > to be au- 
tomatically satisfied, thanks to the entropy term G(X). However, the latter 
disappears in the limit T — ► 0, where one faces the difficulty that the optimality 
condition (|10|) rijip'(xij) = Xj — Xi is still justified only if Xij is freely adjustable, 
that is if x^ > 0. 

For the st-shortest path problem (p(x) = x, one gets, assuming the solution to 
be unique, the well-known characterisation (see e.g. Ahuja et al. (1993) p. 107): 



occurring in the dual formulation of the st-shortest path problem, namely "max- 
imize At — A s subject to Xj — Xi < rij for all i,j". Here Xi is the shortest-path 
distance from s to i. 

For the si-electrical circuit problem ip(x) — x 2 /2, one gets rijXij = Xj — Xi 
if x^ > 0, in which case Xji > cannot hold in view of the positivity of the 
resistances, thus forcing Xji — 0. Hence 



expressing Ohm's law for the currrent intensity x^ (Kirchhoff 1850), where A^ 
is the electric potential at node i. 

3 Illustrations and case studies: simple flow and net flow 

Let us restrict on si-shortest path problems, i.e. <p(x) — x, whose free energy is 
homogeneous in the sense F(vX) = vF(X) where v > is the value of the flow 
in (gl). 



F(X st ) = -T\nz s , 




if x^ > 
if xn = 




> 



if Xj > Xi 
otherwise 
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Graphs are defined by a n x n Markov transition matrix W together with 
a n x n positive resistance matrix R. Fixing in addition s, t and f3, yields an 
unique simple flow xfj, computable for any W (reversible or not) and any R 
(symmetric or not) - a fairly large set of tractable weighted networks. 

An apparent class of networks consists of binary graphs, defined by a symmet- 
ric, off-diagonal adjacency matrix, with unit resistances and uniform transitions 
on existing edges (random walk). 

Such are the graphs A (Figure [J) and B (Figure [2]) below. Graph C (Figure 
[3]) penalises in addition two edges forming short-cut from the point of view of 
W, but with increased values of their resistance. 




Fig. 1. Graph A is a square grid with uniform transitions and resistances. The resulting 
(high values in red, low values in yellow) simple flow icfj and net flow vfj from s (white 
node) to t (black node) are depicted respectively on the left and middle picture with 
P = (random walk) and on the right with ft = 50 (shortest-path dominance). Note 
the simple flow and net flow to be identical at low temperatures. 



Among the wide variety of graphs defined by a (W, R) pair, the plain graphs 
A, B and C primarily aim at illustrating the basic fact that, at high tempera- 
ture, reverberation among neighbours of the source may dramatically lengthen 
the shortest path - an expected phenomenon (Figure [4]) . 

Another quantity of interest is the net flow 

v%:=\xf j -x%\ (18) 

discounting "back and forth walks" inside the same edge, as discussed by New- 
man (2005): as a matter of fact, the presence of such alternate moves mechani- 
cally increases the simple flow inside an edge or node, especially near the source 
at high temperature (Figures [IJ [2] and left), giving the false impression the 
behaviour is more entropic (that is, random-walk dominated) around the source, 
which is erroneous. 

The net flow could also reflect a more realistic behavior of some agents, 
who rarely go back along the edge from where they came if there is another 



\ 





\ 



i 



\ 



Fig. 2. Graph B consists of two cliques K4 joined by two edges, with uniform tran- 
sitions and resistances. Again, the resulting (high values in red, low values in yellow) 
simple flow x"j and net flow i/y from s (white node) to t (black node) are depicted 
respectively on the left and middle picture with /3 = (random walk) and on the right 
with /3 = 50. 

I o a 



Fig. 3. Graph C consists of two cliques K$ joined by two paths: the upper one consists 
of five edges, each with unit resistance, while the lower one contains two edges, each 
with resistance tenfold larger. The resulting (high values in red, low values in yellow) 
simple flow a;f| and net flow u*j from s (white node) to t (black node) are depicted 
respectively on the left and middle picture with /3 — (random walk) and on the right 
with P = 50. 



way. In a way, it captures the resulting "trend" of the particles within their 
random movements. Note that the net flow converges to the simple flow at low 
temperature, since the simple flow is then directed in one way (Figures [TJ [5] and 
H right). 

4 Edge and vertex centrality betweenness 

Several flow-based indices of betweenness centrality have been proposed ever 
since the shortest-path centrality pioneering proposal of Freeman (1977). In par- 
ticular, random-walk centrality indices have been discussed by Noh and Rieger 
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Fig. 4. The average time x„ to reach t from s is minimum for T = 0, and decreases 
with the inverse temperature /3. Black: graph ^4; Red: graph B; Blue: graph C. 



(2004) and Newman (2005). In this paper, we study the (unweighted) mean flow 
betwenness, denned for edges and vertices respectively as 



1 



n(n 



E 



1) "V 

' s,t\s^t 



< Xi, > : 



=< x.i > (19) 



where the latter identity results from the conservation condition (J5J). Definition 
(|19p is intuitive enough: an edge is central if, on average (that is by considering 
all pairs of distinct source-targets couples) , it carries a large amount of flow. A 
more formal motivation arises from sensitivity analysis, with the result 



dF(X(R)) 



E 



hi 



dF(X(R))dx H (R) 
dxki (R) dnj 



■Xij(R) 



where F(X(R)) = Y^ij r ij x lj {R) + TG{X(R)) is the minimum free energy ^ 
under the constraints of Section |2~T1 and ry the resistance of the edge ij. Note 
that < x.. >:= Y^j < x »j > represents the average time to go from a vertex s 
to another vertex t and to return to s, averaged over all distinct pairs st. One 
can also define the relative mean flow betwenness as 



< x.. > 



< Xj, > 

< x„ > 
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with the property Cy > 0, J^ij c ij = 1 an d <k = Cj« = c »i- 

Another candidate for a flow-based betweenness index is the mean net flow, 
again defined for edges and vertices as 

< v a >■■= n(n 1 _ p; E 4* < >: = E < >=< > ( 2 °) 

Middle pictures in Figures [SJ [B] and [7] below demonstrate how the mean net 
How "substracts" the mechanical contribution arising from back and forth walks 
inside the same edge, in better accordance to a common sense notion of centrality. 
Also, the sensitivity of the trip duration with respect to the edge resistance 

_d<x..(R)> 

constitutes yet another candidate, amenable to analytic treatment; its study 
extends beyond the size of the paper. 

5 Illustrations and case studies: mean flow and mean net 
flow 
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Fig. 5. Mean flow < Xij > and mean net flow < Vij > in graph A, with /3 = (left 
and middle) and /3 = 50 (right); high values in red, low values in yellow. 



Figures [5j [6] and [7] depict the mean flow betweenness and the mean net 
flow betweenness (fT9|) for the three graphs of Section [3l at high temperatures 
(left and middle) and low temperatures (right). Here < Xij >—< Xji > due to 
the symmetry of R and the reversibility of W. Visual inspection confirms the 
role of the mean flow as a betweenness index, approaching the shortest-path 
betweenness at low temperatures. 

At high temperatures, the mean flow < x^j > turns out to be constant 
for all edges ij, a consistent observation for all "random- walk type" networks 
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Fig. 6. Mean flow < Xij > and mean net flow < > in graph B, with j3 = (left and 
middle) and /? = 50 (right); high values in red, low values in yellow. 



Fig. 7. Mean flow < Xij > and mean net flow < Vij > in graph C, with f3 — (left 
and middle) and f3 — 50 (right); high values in red, low values in yellow. 



we have examined so far. As a consequence, the mean flow centrality of a node 
< Xi, > is proportional to its degree for ft — > 0, and identical to the shortest-path 
betweenness for j3 — > oo. The former simply measures the local connectivity of 
the node, while the latter also takes into account the contributions of the remote 
parts of the network, in particular penalising high- resistance edges in comparison 
to low- resistance ones (Figure [7]) . 

At low temperature, the net mean flow converges (together with the sim- 
ple flow) to the shortest-path betweenness (Figures [SJ |6] and [71 right). At high 
temperatures, the net mean flow betweenness is large for edges connecting clus- 
ters, but, as expected, small for edges inside clusters. Hence an original kind of 
centrality, the "net random walk betweenness" , differing from shortest-path and 
degree betweeness, can be identified (Figures [SJ H] and [JJ middle). As suggested 
in Figure [8] (right), contributions of both origins manifest themseves in the mean 
flow node centrality, for intermediate values of the temperature. 



o 
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Fig. 8. Left: mean net flow centrality for the vertex in the "high-resistance path" (red 
line) of network C, and for one of the nodes in the "low-resistance path" (black line) 
of network C. Right: inter-nodes correlation between the mean net flow centrality with 
itself at j3 — (net random walk centrality; red line) and at /3 = oo (shortest-path node 
centrality; blue line), in function of the inverse temperature p, for graph C. The sum 
of the two lines (black line) is maximum for /3 = 0.04, arguably indicating a transition 
between an high- and a low-temperature regime. 



6 Conclusion 



This paper proposes a new rationale and mechanism permitting to interpolate 
between shortest paths and random walks. The composition is controlled by 
a continuous parameter T, the temperature, allowing to introduce noise and 
fluctuations around the shortest path (at low temperature) or, conversely, to 
introduce a preferential trend in the random walk (at high temperature). In- 
termediate values of T constitute compromises attempting to capture effects of 
both ends of the spectrum. The construction applies to any network endowed 
with a Markov transition matrix W and a resistance matrix R, both unrelated 
a priori; continuity at T = and T = oo however requires Wij > whenever 
Tij < oo. 

The formalism allows the introduction of generalised classes of betweenness 
centrality indices for edges and nodes. In particular, the mean flow node be- 
tweenness interpolates between degree centrality and shortest-path centrality. 
Also, the mean net flow behaves at high temperature as a corrected random 
walk betweenness, where back and forth walks and reverberations inside local 
clusters have been filtered out. 

The formalism and its study can be generalised in many directions: i) further 
study of non-linear resistances, ii) alternatively defined path-based centrality 
indices, iii) larger networks, iv) real networks, v) inclusion of further functionals, 
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e.g. based upon the value of the path (|4| or its capacity ([5]). Notwithstanding 
the large variety of resulting optimal paths and associated centrality measures, 
some analytical progress can yet be expected in view of the convexity of the 
admissible solutions and functionals. 

From an empirical view, one can wonder whether an observed si-paths (spa- 
tial trop, social influence, series of decisions, etc.) can be modeled by this simple 
flow. More modestly, one can seek to estimate the temperature of an observed 
path X st . Maximum- likelihood type arguments, necessitating a probabilistic 
framework to be exposed in another communication, suggest the estimation rule 
for T 

U(X st ) = U{X st (T)) 

where U is the energy functional in Section 1231 Here X st is the observed, em- 
pirical path, and X st (T) is the optimal path ([TBI IT7| at temperature T. 

References 

Ahuja, R.K., Magnanti, T.L. and Orlin, J.B. (1993) Network Flows. Theory, algorithms 

and applications, Prentice Hall 
Borgatti, S.P. (2005) Centrality and network flow, Social Networks 27, pp. 55-71 
Kemeny, J.G. and Snell, J.L. (1976) Finite Markov Chains, Springer 
Farnsworth, K. D. and Beecham, J. A. (1999) How Do Grazers Achieve Their Distribu- 
tion? A Continuum of Models from Random Diffusion to the Ideal Free Distribution 
Using Biased Random Walks, The American Naturalist 153, pp. 509-526 
Fouss, F., Pirotte, A., Renders, J.-M. and Saerens, M. (2007) Random-Walk Compu- 
tation of Similarities between Nodes of a Graph with Application to Collaborative 
Recommendation, IEEE Transactions on Knowledge and Data Engineering 19, pp. 
355-369 

Freeman, L.C., Borgatti, S.P. and White, D.R. (1991) Centrality in valued graphs: A 

measure of betweenness based on network flow, Social Networks 13, pp. 141-154 
Kirchhoff, G. (1850) On a deduction of Ohm's laws, in connexion with the theory of 

electro-statics, Philosophical Magazine 37, p. 463 
Newman, M.E. J. (2005) A measure of betweenness centrality based on random walks 

Social Networks, Social Networks 
Noh, J.-D. and Rieger, H. (2004) Random walks on complex networks. Phys. Rev. Lett. 

92, 118701 

Travers, J. and Milgram, S. (1969) An experimental study of the small world problem, 

Sociometry 32, pp. 425-443 
Zhou, T. (2008) Mixing navigation on networks, Physica A 387, pp. 3025-3032 



